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Device and method for displaying ultrasound images of a vessel 
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The invention relates to a device and a method for displaying a vessel with the 
aid of ultrasound images, the vessel being subject to a cyclic intrinsic movement. 

In catheter examinations of the heart, a number of angiographic X-ray images 
of the heart are usually generated from various directions, a contrast agent typically being 
5 injected during the recording. The angiograms of the vascular system that are thus obtained 
may than be of assistance, for example, in locating the site of a lesion that is to be treated, or 
else they may be used as (static) road maps for navigating a catheter during a subsequent 
medical intervention. 

Moreover, so-called intravascular ultrasound probes (IVUS probes) are used, 
10 which can be guided for example by means of a catheter through a vessel and generate 
ultrasound section images transversely to the vessel axis. Ultrasound images are often 
generated in a so-called pullback sequence using an IVUS probe. In this case, the IVUS 
probe is pulled back through the vessel at a defined speed while at the same time recording a 
series of ultrasound images. The IVUS images provide useful additional information about 
15 the vessel or a vessel lesion, for example the length of a vessel section affected by a disease, 
the minimum/maximum thickness of a vessel, the type of a deposit and the like, 

US 6 148 095 discloses a method of reconstructing three-dimensionally 
winding vessels such as, for example, the coronary vessels, in which firstly the three- 
dimensional course of the vessel is reconstructed from biplanar angiographs, and this is then 
20 combined with the two-dimensional section images of an IVUS pullback sequence. Although 
good reconstruction of the three-dimensional course of the vessel is possible by means of the 
method, the result is a static representation of the vascular tree, in which intrinsic movements 
and deformations on account of the heartbeat and/or breathing cannot be seen. When 
navigating a catheter with an intervention device such as, for example, a stent or a balloon 
25 toward a lesion during a medical intervention, the treating physician therefore has to correlate 
the current fluoroscopic images of the catheter with the static three-dimensional vessel model 
in order to be able to use the information contained in the IVUS images. 

Against this background, it is an object of the present invention to provide 
means of displaying a vessel which allow more convenient use of information from 
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intravascular ultrasound images, this being continually adapted to an ongoing medical 
intervention. 

This object is achieved according to a first aspect of the invention by a device 
having the features of claim 1, according to a second aspect of the invention by a device 
5 having the features of claim 2, and also by methods having the features of claims 10 and 1 1 . 
Advantageous refinements are given in the dependent claims. 

According to a first aspect of the invention, the device, which is used to 
display a vessel or a section of a vascular system, comprises the following components: 

a) a (data) memory in which a sequence of intravascular ultrasound images is 
10 stored, the ultrasound images being indexed by the respective locations (x) of their recording 

in the vessel. Said ultrasound images may have been generated, for example, with the aid of 
an intravascular ultrasound probe. In particular, the images may come from an IVUS 
pullback sequence, wherein as the IVUS probe is being pulled back, the respective stopping 
location of the IVUS probe in the vessel is determined in parallel by means of further 
15 imaging. The latter may moreover be estimated from existing images of the vascular system 
(angiography). 

b) a data input for information which describes (at least) a current location in 
the vessel. By way of example, a pointer (mouse, etc.) could be connected to this input, by 
means of which pointer a user indicates, on a road map, a current location of interest to him 

20 in the vessel, or else a locating device could be connected to said input, which locating device 
detects, for example by means of magnetic fields, the current stopping location of an 
intervention device on a catheter. Other examples will be described within the context of the 
developments of the invention. 

c) a display unit such as, for example, a monitor for displaying images of the 

25 vessel. 

The device comprising the described components is furthermore designed to 
select from said memory at least one ultrasound image and to display it on the display unit, 
wherein the ultrasound image corresponds to the current location in the vessel indicated at the 
data input. By way of example, an ultrasound image whose associated recording location is 
30 identical to the current location or is no more than a predefined distance from the latter may 
be selected from the memory. The selection function may be implemented in the device for 
example by means of a suitably programmed microprocessor. 

According to a second aspect, the invention comprises a device for displaying 
a vessel or a section of a vascular system which is subject to a cyclic intrinsic movement. The 
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most important typical causes of such an intrinsic movement are the heartbeat and breathing. 
The most important typical causes of a change in the vessel cross section is pathological 
constriction. The cyclic intrinsic movement is to be characterized by a (single-component or 
multicomponent) parameter. For the heartbeat, this parameter is for example the electrical 
5 heartbeat phase that can be quantitatively described by the electrocardiogram (ECG). The 
device comprises the following components: 

a) a (data) memory in which a sequence of intravascular ultrasound images is 
stored, the ultrasound images being indexed by the respective values of the parameter of the 
intrinsic movement belonging to the recording time. Said ultrasound images may have been 

10 generated, for example, with the aid of an intravascular ultrasound probe. In particular, the 
images may come from an IVUS pullback sequence, wherein as the IVUS probe is being 
pulled back, the parameter of the intrinsic movement (for example the ECG) is recorded in 
parallel, as is preferably also the respective stopping location of the IVUS probe in the vessel, 
using methods of the type mentioned above. The latter may moreover be estimated from 

15 existing images of the vascular system (angiographs). 

b) a data input for the current value of the parameter of the intrinsic 

movement. 

c) a display unit such as, for example, a monitor for displaying images of the 

vessel. 

20 The device comprising the described components is furthermore designed to 

select from said memory at least one ultrasound image and to display it on the display unit, 
wherein the selected ultrasound image corresponds to the current value of the parameter of 
the intrinsic movement at the data input. By way of example, an ultrasound image whose 
associated ECG phase is identical to the current ECG phase or deviates from the latter by no 

25 more than a predefined amount may be selected from the memory. The selection function 
may be implemented in the device for example by means of a suitably programmed 
microprocessor. The device may moreover also have the features of a device according to the 
first aspect of the invention, that is to say an additional indexing of the ultrasound images by 
their recording location, a data input for a current location and also a selection function that is 

30 additionally based on the location. On account of the analog structure of the devices and their 
ability to be combined, special refinements of the invention are hereinbelow described in 
parallel for the "device according to the first and/or second aspect of the invention". 

The described devices according to the first and/or second aspect of the 
invention allow, in real time during a medical intervention, optimal use of information 
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contained in IVUS images of a vessel or vessel lesion. This is made possible in that the 
device determines and displays on the display unit the IVUS image(s) corresponding to a 
current location in the vessel and/or to the current phase of the cyclic intrinsic movement. 
The physician therefore need not be satisfied with a possibly misleading static display of 
5 IVUS images, but rather sees at all times the images corresponding to the actual state. This 
makes it much easier for him to navigate a catheter to the desired target position such as, for 
example, a stenosis. 

As has already been mentioned, the causes of the cyclic intrinsic movement of 
vessels are primarily the heartbeat and breathing. The device according to the first and/or 
10 second aspect of the invention therefore preferably comprises an electrocardiograph for 

recording a (electrical) parameter that characterizes the heart phase and/or a breathing sensor 
for recording a parameter that characterizes the breathing phase. 

The device according to the first and/or second aspect of the invention 
furthermore preferably comprises an intravascular ultrasound probe (IVUS probe), by means 
1 5 of which the ultrasound images stored in said memory can be generated. As mentioned in the 
introduction, such IVUS images contain useful additional information for assessing the 
condition of a vessel. 

The device according to the first and/or second aspect of the invention may 
furthermore comprise an X-ray device for generating X-ray projection images of the vessel. 
20 The X-ray device may in particular be coupled to a data input of the device in order to 

provide a current image of the vessel in the form of an X-ray projection image. Moreover, the 
X-ray projections may also be used during generation of a (pullback) sequence of IVUS 
images, in order to determine the respective stopping location of the IVUS probe. 

In another development, the device according to the first and/or second aspect 
25 of the invention comprises a device for injecting contrast agent into the vessel. By means of 
contrast agent injections it is possible to considerably improve the representation of the 
vessel on (X-ray) images. In particular, angiograms can be produced using a contrast agent 
and an X-ray device. 

Furthermore, the device according to the first and/or second aspect of the 
30 invention may comprise a further memory in which angiograms of the vessel are stored, these 
being indexed with the respective values of the parameter of the cyclic intrinsic movement 
belonging to their recording time according to the second aspect of the invention. For each of 
the stored angiograms it is thus known from which phase of the cyclic intrinsic movement it 
comes. The device is in this case furthermore designed to select from said further memory 
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and display on the display unit at least one angiogram corresponding to the current value of 
the parameter of the intrinsic movement. The angiograms, which clearly show the course of 
the vessel, are thus displayed on the display unit in real time in a manner corresponding to the 
actual state of the intrinsic movement (for example heartbeat phase or breathing phase). The 
5 ultrasound images and the angiograms are preferably stored in the same physical memory at 
different storage locations. 

In another development of the device according to the first aspect of the 
invention, said device has a data input for data of a current image of the vessel. This current 
image may be, for example, an X-ray image or an NMR image of the vessel. Furthermore, 

10 the device is designed to determine from a current image of the vessel the position of an 

object of interest (e.g. a specific anatomical structure or a catheter in the vessel) and use it as 
"current location" to select a corresponding ultrasound image from the memory. In other 
words, of the stored ultrasound images, only those which show the vessel in the region of the 
object are displayed on the display unit. The physician thus obtains a display of ultrasound 

15 images that is updated in real time and corresponds to the position of an object of interest, so 
that he can make optimal use of the information contained therein. Furthermore, the current 
image present in each case at the data input is preferably also displayed on the display unit 
together with the intravascular ultrasound images, and this allows the physician to observe a 
medical intervention in an optimal manner. 

20 When, in the abovementioned case, the intravascular ultrasound images are 

indexed by the location of their recording, the device according to the first and/or second 
aspect of the invention may furthermore be designed to display an (any) image of the vessel 
on the display unit and to show with reference to this image the geometric position of an 
ultrasound image that is likewise displayed on the display unit. The image of the vessel may 

25 for example be a current image or a stored angiogram of the vessel. Since, in respect of each 
ultrasound image, it is known at which position of the vessel it was generated, this position of 
the ultrasound image can be marked, for example by means of an arrow or a cross, on the 
image of the vessel that is displayed. The user can then see at a glance to which location a 
displayed ultrasound image belongs. 

30 The invention furthermore relates to a method of displaying a vessel, said 

method comprising the following steps: 

a) generating a sequence of intravascular ultrasound images while at the same 
time recording the associated locations in the vessel, 
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b) detecting a current location in the vessel and optionally generating a current 
image of the vessel, 

c) selecting at least one ultrasound image corresponding to the current 

location, 

5 d) displaying the selected ultrasound image, optionally together with a current 

image or a stored image corresponding thereto. 

The invention moreover also relates to a method of displaying a vessel which 
is subject to a cyclic intrinsic movement that can be characterized by a parameter. The 
method may in particular be combined with a method of the type mentioned above and 
10 comprises the following steps: 

a) generating a sequence of intravascular ultrasound images while at the same 
time recording the associated parameters of the intrinsic movement, 

b) determining the current value of the parameter of the intrinsic movement 
and optionally generating a current image of the vessel, 

15 c) selecting at least one ultrasound image corresponding to the current value of 

the parameter of the intrinsic movement, 

d) displaying the selected ultrasound image, optionally together with the 
current image or a stored image corresponding thereto. 

Said methods in general implement the steps that can be carried out using a 
20 device according to the first and/or second aspect of the invention. With regard to a 

description of the details, advantages and developments of the method, reference is therefore 
made to the explanations given above. 



25 The invention will be further described with reference to an example of 

embodiment shown in the drawing to which, however, the invention is not restricted. 

The single figure schematically shows the components of a device according 
to the invention for displaying a vessel. 

30 

The left-hand part of the figure shows a vessel (segment) 2 within the body of 
a patient 1, wherein said vessel may be, for example, a coronary vessel. X-ray projection 
images A of the vessel 2 may be generated by means of an X-ray radiation source 3 and an 
X-ray detector 7, and forwarded to a data processing device 8 (workstation, etc.). 
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Furthermore, an IVUS probe 5 for generating intravascular ultrasound images 

I is arranged at the tip of a catheter 6. By means of the IVUS probe 5, in particular a so-called 
pullback sequence (see dashed lines) can be generated when the probe 5 is pulled back 
through the vessel at a defined speed and in the process generates ultrasound section images I 

5 at regular time intervals, said ultrasound section images being transmitted to the data 

processing device 8. The position of the IVUS probe 5 during an image I generated by the 
latter, which position can be described by a coordinate x, may be determined in various ways. 
For instance, by way of example it is possible during the ultrasound recordings for X-ray 
projections to be produced at the same time, from which the associated position of the IVUS 

10 probe 5 can be determined. In order to reduce the X-ray exposure for the patient 1, however, 
it is also possible for X-ray projections to be generated only at the start and at the end of the 
IVUS pullback sequence, it being possible for the positions of the intermediate IVUS images 
to be estimated on account of the defined pullback speed of the probe 5. 

Furthermore, an electrocardiograph 4 is also shown in the left-hand part of the 

15 figure, by means of which the electrical heart activity E (electrocardiogram) can be recorded 
and fed to the data processing device 8. The ECG represents a parameter E for characterizing 
the heartbeat phase, which has a dominating effect on the location and the shape of the vessel 
2. 

The data processing device 8 comprises a central processor 9 (CPU) which 
20 receives the abovementioned information (ECG E, IVUS images I, X-ray projections A) and 
further processes it. The processor 9 is connected to two memories or memory areas 10 and 

I I (RAM, hard disk, etc.) and also to a display unit 12 (monitor). 

Stored in the first memory area 10 are the IVUS images I which have been 
generated in a pullback sequence of the IVUS probe 5. During the pullback sequence, the 

25 ECG E was recorded in parallel. Each of the IVUS images stored in the memory area 1 0 can 
thus be indexed by the heartbeat phase E at the time they were generated and the location x 
where they were generated: I = I(E, x). Since an IVUS pullback sequence typically lasts 
about 30 seconds (and comprises about 10 to 30 ultrasound images per second), about 30 
heart cycles and two to four breathing cycles fall within the time of the sequence. The 

30 sensory detection of the breathing cycle and the indexing of the ultrasound images I with a 
corresponding parameter is not shown in the figure for reasons of clarity. However, it is 
preferably likewise carried out and dealt with in a manner similar to the characterizing by the 
ECG E. 
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* 

The second memory area 1 1 comprises a sequence of angiograms A*. These 
are X-ray projections of the vessel 2 which have been recorded with administration of 
contrast agent. By virtue of a parallel recording of the ECG E, the angiograms A* can once 
again be indexed by the associated heartbeat phase (and in accordance with what has been 
5 stated above also by a breathing cycle). 

The generation of the ultrasound images I(E,x) of the memory area 10 and 
where appropriate of the angiograms A*(E) of the memory area 1 1 takes place in the run-up 
to a medical intervention. During the actual intervention, e.g. the placing of a stent with the 
aid of a catheter 13, the catheter must be pushed as precisely as possible up to the actual 

10 stenosis with continual X-ray-fluoroscopic observation (but without contrast agent in order to 
minimize the exposure of the patient). The precise placing of the stent in this case has a 
decisive effect on the success of the intervention or the risk of subsequent restenosis. In order 
in this connection to allow the physician to make optimal use of the available information in 
real time during the intervention, the data processing device 8 is designed, by means of 

15 corresponding programs for the processor 9, etc., to carry out the steps explained below. 

Firsdy, as already mentioned above, the catheter 13 is pushed up to the lesion 
under continual fluoroscopic observation. On each current fluoroscopic X-ray image A t 
provided by the X-ray device 3, 7, the instantaneous stopping location of the catheter 13 is 
located by the data processing device 8, and the X-ray image A t is displayed on the display 

20 unit 12. By virtue of the electrocardiogram E recorded at the same time, the angiographic 
image A*(E) that best corresponds to the current fluoroscopic image A t in terms of the ECG 
phase can be selected from the memory area 11, and displayed for example on the display 
unit 12 next to the image A t or superposed on the latter. Details of such a combination of 
current fluoroscopic images and static "road maps" are known and therefore do not have to 

25 be discussed in any more detail in the present text. 

Furthermore, one or more IVUS images I(E,x) are selected from the memory 
area 10 by the data processing device 8 in a manner corresponding to the ECG phase E of the 
current image At. In the example shown, three IVUS images I|, I 2 , 13 have been determined in 
this way and displayed on the display unit 12 next to the picture of the current image A t . The 

30 choice of IVUS images Ii, I2, 13 corresponding to the heartbeat phase of the current image A t 
ensures that the physician is shown on the monitor 12 at all times X-ray information and 
intravascular ultrasound information from the same current heartbeat phase. In this way he 
can make optimal use of the important information contained in the IVUS images. 
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The IVUS images Ij, I2, 13 displayed on the monitor 12 belong to various 
known positions x along the vessel 2. As shown in the figure, in this respect the physician is 
shown the respective location of the IVUS images h 9 h$ h for example by connecting lines 
on the current image A t . 
5 According to one modification or further development of the method, the 

processor 9 selects, among the IVUS images I(E,x) from the memory area 10, only one (or a 
few) which have been generated at least approximately at the current stopping location of the 
catheter 13. In a modification of the figure, therefore, only the IVUS image I 2 which 
corresponds to the current stopping location of the catheter tip 13 would be displayed on the 

10 monitor 12. The physician then sees, next to the current fluoroscopic image A t , at all times 
the associated vessel cross section at the location of the catheter tip. In this connection, it may 
be useful or necessary to carry out a weighting of the selection criteria "corresponding to the 
stopping location of the object" and "corresponding to the ECG phase". That is to say, 
depending on the settings of the user, that IVUS image which best corresponds to the current 

1 5 position of the catheter 1 3 is selected and displayed, or that IVUS image which best 

corresponds to the current heart phase is selected and displayed, or an IVUS image in which 
a weighted compromise between the abovementioned criteria is met is displayed. 

Finally, it should be pointed out that the method and system described 
preferably also take account of the breathing phase, which is dealt with in a manner 

20 analogous to the heart phase. 



